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fS (54) Title: METHOD OF AND APPARATUS FOR REMOTE MONITORING 
l> 

^5 (57) Abstract: A method and apparatus is described for remote monitoring of a business site network. One or more remote satellite 
£5 systems may be strategically positioned at different points on the Internet that are close to backbone networks in order to monitor 
and evaluate typical user interactions with a business site. By positioning the remote satellite systems at points near backbones 
Q approximate to those of users accessing a business site, a more accurate analysis of a site's performance may be performed that 
better reflects the experience that similarly connected users experience. Various network and system parameters of a business site 
may be monitored, such as threshold timing parameters and correctness parameters. 
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METHOD OF AND APPARATUS FOR REMOTE MONITORING 

FIELD OF THE INVENTION 

This invention relates to the field of network systems and, in particular, to 
remote monitoring of a computer system on a network. 

BACKGROUND 

The Internet may be described in a simplified manner as a collection of 
computer systems (e.g., clients and servers) that are interconnected by 
public/private networks (e.g., transmission lines and routers) to enable the 
transfer of information among them, as illustrated in Figure 1. These computer 
systems are often modeled by their function: client-server. In the client-server 
model, communication generally takes the form of a request from the client to 
the server asking for an operation to be performed (e.g., request for data). The 
server performs the work and sends a reply. A client may then retrieve and 
display the requested information. However, a computer system may operate as 
both a server and a client. 

Client-server systems communicate with each other using a variety of 
network protocols, such as Transmission Control Protocol/Internet Protocol 
(TCP/IP) and Integrated Packet Exchange (IPX), and a variety of application 
protocols, such as HyperText Transfer Protocol (HTTP) and File Transfer 
Protocol (FTP). A user typically views the Internet as a collection of web pages 
that are typically located on a server at a network site. Each web page may 
contain text, embedded components such as graphic image files, and address 
links to other pages referred to as a Uniform Resource Locator (URL). Web 
pages are viewed using a program called a browser that resides on a user's client 
computer. The browser retrieves information from a requested page on a server, 
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interprets the data and formatting commands, and displays the text and special 
accessory files, such as images, on the user's client system. 

Increased traffic on the Internet has resulted in performance problems 
with sites (systems and connections), such as reduced download speeds during 
periods of heavy loads (a measure of system activity). Businesses are faced with 
the increasing burden of monitoring and testing the performance of their sites on 
a real-time basis. For example, a business may rely on its on-line site to sell a 
product. If the business site, or a portion thereof (e.g., a web page or server), is 
not operating properly, orders for a product may not be able to be placed. This 
may result in a business suffering financial consequences. As such, a business 
has an interest to know if and when any portion of its site ceases to operate 
properly from its customer's point of view. 

The performance of a site and its computer systems may be measured in 
different ways. One measure of performance is the accessibility of the computer 
system through a backbone used to connect the computer system with an end 
user. A backbone, also referred to as an Autonomous System (AS) network, is a 
set of transmission lines and hardware that a business site may be connected to 
for long distance communication. Another measure of performance is the 
amount of time it takes to retrieve and display the information to the user, 
referred to as download speed. 

One way to monitor and analyze a business site's performance is to 
measure performance on the server side (the computer system providing the 
pages requested by the user). One problem with such a method is that the 
performance experienced by a user may not be readily determined from 
measurements made from the server. For example, the speed with which a 
server delivers requested information may not correlate with the speed 
experienced on the client side by a user due to, for example, congested or 
downed transmission lines. 
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Another way to monitor and analyze a site's performance is to perform 
client side measurements using an actual user's client system. For example, a 
user's client browser may be configured to record download speeds of particular 
transactions. Such performance information is stored on a client's system and 
then obtained from the laser's system. One problem with such a method is that 
the performance information collected is based on user specific factors that may 
be uncontrollable and may not be common to other users. For example, a user 
running several simultaneous, high bandwidth downloads will typically 
experience slower performance than a user on an identical client system with an 
identical browser who is running a single low bandwidth download. 

Another problem with client side measurements is that the collected 
performance information may be limited to only measuring the total load time 
of a web page and throughput (bytes of data sent over an end-to-end transaction 
time). The condition of the network connection to the client may not be included 
in the collected information. As such, allowances for these other factors may not 
be made when analyzing performance. 

Moreover, strictly load time and throughput measurements do not reflect 
the quality of the downloaded information. For example, if a server is non- 
operational, then requests to a web page on the server may return an error 
message response (e.g., "can't process request") very quickly. This would 
appear to be a period of exceptionally good download performance when, in 
fact, no content from the site was downloaded to the user. Therefore, such a 
method may not provide an accurate or detailed analysis of a site's performance 
that reflects a customer's true experience. 

Furthermore, prior methods of web site analysis use browsers that are. 
very code intensive and operating systems that may not be very reliable. Such 
platforms may not be very scalable or robust and, thus, may not be desirable. 
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SUMMARY OF THE INVENTION 

The present invention pertains to a method of and apparatus for remote 
monitoring. In one embodiment, the apparatus may includes an intranetwork, 
an extranetwork coupled to the intranetwork, and a first host digital processing 
system coupled to the intranetwork with the first digital processing system has 
performance parameters. The first remote digital processing system may be 
coupled to the extranetwork to monitor a performance parameter of the first 
host digital processing system. 

In one embodiment, the method may include positioning a remote digital 
processing system on a backbone network remotely from a host digital 
processing system with the host digital system coupled to the backbone network 
through an intranetwork. The method may also include monitoring a 
performance parameter of the host digital processing system with the remote 
digital processing system. 

Additional features and advantages of the present invention will be 
apparent from the accompanying drawings and from the detailed description 
that follows. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention is illustrated by way of example, and not by way of 
limitation, in the figures of the accompanying drawings and in which: 

Figure 1 illustrates an internetwork architecture. 

Figure 2 illustrates one embodiment of a network site monitoring system. 
Figure 3 illustrates one embodiment of remote satellite systems coupled 
to an IP network. 

Figure 4 is a block diagram illustrating an exemplary architecture of a 
remote satellite monitoring system. 

Figure 5 illustrates one embodiment of a remote satellite system in the 
form of a digital processing system. 

-4- 



WO 02/37280 



PCT/US01/46117 



Figure 6 illustrates an alternative embodiment of a network site 
monitoring system. 

Figure 7 A illustrates one embodiment of a method of remote monitoring. 

Figure 7B illustrates one embodiment of a configuration interface. 

Figure 8 illustrates one embodiment of a timing parameters measurement 
process. 

Figure 9 illustrates one embodiment of a parameters correctness 
verification process. 

DETAILED DESCRIPTION 

In the following description, numerous specific details are set forth such 
as examples of specific systems, languages, components, etc. in order to provide 
a thorough understanding of the present invention. It will be apparent, 
however, to one skilled in the art that these specific details need not be 
employed to practice the present invention. In other instances, well known 
materials or methods have not been described in detail in order to avoid 
unnecessarily obscuring the present invention. 

The present invention includes various steps, which will be described 
below. The steps of the present invention may be performed by hardware 
components or may be embodied in machine-executable instructions, which may 
be used to cause a general-purpose or special-purpose processor programmed 
with the instructions to perform the steps. Alternatively, the steps may be 
performed by a combination of hardware and software. 

The present invention may be provided as a computer program product, 
or software, that may include a machine-readable medium having stored 
thereon instructions, which may be used to program a computer system (or 
other electronic devices) to perform a process according to the present invention. 
The machine-readable medium may include, but is not limited to, floppy 
diskettes, optical disks, CD-ROMs, and magneto-optical disks, ROMs, RAMs, 
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EPROMs, EEPROMs, magnet or optical cards, flash memory, or other type of 
media / machine-readable medium suitable for storing electronic instructions. 

Figure 2 illustrates one embodiment of a network site monitoring system. 
The network monitoring system 200 may include various hardware and 
software components to perform monitoring functions. The network monitoring 
system 200 may include a business site 210, one or more remote satellite systems 
(e.g., remote satellite system 250) located remotely from business site 210, and a 
monitoring operations center (MOC) 230. Business site 210, remote satellite 
system 250 and MOC 230 may be coupled together via extranetwork 220, such as 
an Internet Protocol (IP) network. 

An IP network transmits data in the form of packets that include an 
address specifying the destination systems for which communication is 
intended. Business site 210, remote satellite system 250, and MOC 230 may 
communicate with each other using various protocols, for examples, HTTP, 
Telnet, NNTP, and FTP. Security layers for managing the security of data 
transmission may also reside between the application protocols and the lower 
protocol (TCP/IP) layers, for examples: Secure Sockets Layers (SSL). 
Alternatively, secure application protocols may be used, for examples, Secure 
HTTP (HTTPS) and Secure Shell (SSH). These various protocols are known in 
the art; accordingly, a detailed discussion is not provided herein. 

In one embodiment, MOC 230 may be located remotely from business site 
210. Alternatively, MOC 230 may be located locally to or within business site 
210. It should be noted that local and remote designations do not necessarily 
refer to geographic relationships but, rather, to network relationships. 

Business site 210 may include one or more computer systems, or hosts, 
(e.g., hosts 211-213) connected together via intranetwork 215. Three hosts 211- 
213 are shown only for illustrative purposes. Business site 210 may have more 
or less than three hosts. Hosts 211-213 may be configured to perform as servers. 
In one embodiment, intranetwork 215 is a local area network (LAN). The local 
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area network may be either a wired or wireless network. Alternatively, hosts 
211-213 may be coupled together vising other types of networks, for example, a 
metropolitan areas network (MAN) or a wide area network (WAN) with various 
topologies and transmission mediums. 

A host (e.g., host 211) may be configured to provide various services for 
clients that are accessed through ports of the host connected to intranetwork 215. 
Types of network services include, for examples, electronic mail using a Simple 
Mail Transfer Protocol (SMTP), web page display using HTTP, news article 
distribution vising a Network News Transfer Protocol (NNTP), fetching email 
from a remote mailbox using a Post Office Protocol-3 (POP3), and text file 
retrieval for viewer displaying using Gopher, etc. Each service may be 
configured on an industry standard port or on a custom port. If a service 
operates with a custom port, then remote satellite system 250 may either be 
preprogrammed with the port information or perform probes to determine a 
port's configuration. 

For example, if host 211 is configured to operate as an HTTP server, 
remote satellite system 250 may attempt to establish a connection to industry 
standard TCP port 80 (or port 443 if HTTPS is used) to determine if it is 
connected to intranetwork 215. If no reply is received, then port 80 for that 
particular host 211 is either down or host 211 may be using a different port for 
the service. 

Figure 3 illustrates one embodiment of remote satellite systems coupled 
to an IP network. In one embodiment, one or more remote satellite systems (e.g., 
remote satellite systems 351-353) may be strategically positioned at different 
points on IP network 320 that are close to network backbones 321-324. Four 
network backbones are shown only for illustrative purposes. The network site 
monitoring system may include more or less than four backbones. Backbones 
are extranetworks that enable high-bandwidth communication, in particular 
long distance communication, between short range networks (e.g., local and 
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regional area networks). Examples of backbones 321-324 include those provided 
by Sprint, AT&T, Exodus, and UUNET. 

Remote satellite systems 351-353 are positioned at points similar to those 
of expected users (e.g, user 340) of business site 310. In one embodiment, remote 
satellite systems 351-353 may be positioned behind peering points between 
backbones. In another embodiment, remote satellite systems 351-353 may be 
positioned at geographically significant locations (e.g., countries, states, and 
cities from which users access network 320) or network-topographically 
significant locations (e.g., close to and far from business site's 310 server). Other 
strategies may be used to position remote satellite systems 351-353. For 
example, in another embodiment, remote satellite systems 351-353 may be 
positioned behind major Internet Service Provider (ISP) proxy servers or behind 
access points for the business users (e.g., large dial-up pools such as America On 
Line and Earthlink, cable ISP providers, DSL providers, ISDN providers, etc.) 

Remote satellite systems 351-353 may operate similar to a client system to 
interact with hosts of business site 310 in order to monitor and evaluate user 
interactions with the business site 310 hosts (i.e., the experience that a user of the 
business site will undergo). It should be noted that the remote satellite systems 
351-353 are not limited to directly accessing a host but may also access a host 
through another system such as a proxy server. 

Business site 310 may designate the URLs of one or more web pages to 
monitor and evaluate. In one embodiment, a business site may be able to pre-set 
cookies in the monitoring configuration to allow remote satellites 351-353 to 
access particular web pages. In general, a business site may serve information 
both in a stateless way (e.g., the corporate info page, a static page that is served 
up the same way to every visitor on each visit) and in a stateful way (e.g., a 
user's account info page, where the information may change between users and 
between each visit of the same user, and where the system must first know some 
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state before serving up information, particularly some user-identifying state 
information like a username). 

In one embodiment, to get the stateful information, a user usually goes 
through a fixed flow. For example, to get to an " Account Information 77 page, a 
user may first have to go through a /7 Login 77 page, then to a /7 Select Account 77 
page. At each stage, the server must know where the user is in the process. That 
information may be maintained with cookies that are small portions of data 
stored on the client machine that are sent tot the server with information 
requests. Typically an unattended agent exercises this flow. The agent runs a 
monitoring script that posts authentication data, accepts the cookie, posts the 
account number, and then examines the final page. However, if the "Login 77 
page is down, the other two pages may not be monitored. As such, by pre- 
setting a cookie with required state information, an unattended agent may verify 
the performance of each page independent of the other pages. 

Referring still to Figure 3, a web page may be configured to perform a 
particular type of transaction, for example, a purchase transaction. These URL 
addresses maybe downloaded to remote satellite systems 351-353 or 
programmed directly into remote satellite systems 351-353. The remote satellite 
systems 351-353 establish connections with the designated URL to perform 
transactions and report on the various system parameters and backbone 
conditions such as transaction times (e.g., connection time, download times, etc.) 
as discussed below. Because remote satellite systems 351-353 are connected to 
backbones 321-324 at points similar to that of a business site's 310 users (e.g., 
user 340), remote satellite systems 351-353 may provide data relevant to the 
experience that similarly connected users experience. The remote satellite 
systems 351-353 collect this data for analysis and report generation. 

In one embodiment, the data is analyzed and a report is generated by the 
remote satellite systems 351-353 and transmitted to MOC 330, with the data also 
being transmitted if desired. Alternatively, the data may be transmitted to MOC 
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330 with the analysis and report being generated at MOC 330. The information 
on remote satellite systems 351-353 may either be pushed or pulled across IP 
network 320 to MOC 330 for processing such as evaluation, notification, and 
reporting. The MOC 330 may then take corrective actions including notifying 
the business site of identified problems; rerouting network traffic; and/or 
contacting a backbone provider directly to fix problems. For example, if the 
access time monitored by remote satellite system 353 on backbone 322 is long 
relative to the time on backbones 321, 323, and 324, then traffic may be rerouted 
to the other backbones until the data collected by remote satellite system 353 
indicates that the problem has been fixed. 

Figure 4 is a block diagram illustrating an exemplary architecture of a 
remote satellite monitoring system. In one embodiment, remote satellite 
monitoring system 400 may include a configuration file or database 410 for 
storing parameters for the different business sites that are monitored. The 
parameters provide a remote satellite system with the information needed to 
monitor a host, for examples, URLs to monitor, thresholds to alert on, 
authentication information for password-protected pages, data to upload, pre- 
defined cookies, and positive/negative search patterns, as discussed below. 

In one embodiment, the information stored in configuration file 410 is 
provided to configuration file reader 420 that reads the information from 
configuration file 410 and provides it to monitoring agent 425. In an alternative 
embodiment, monitoring agent 425 may read the configuration database 
directly. 

Once monitoring agent 425 has the configuration information, one or 
more of the following operations may be performed for each configured 
transaction. In one embodiment, timing analyzer 440 may be used to measure 
timing threshold parameters. Timing threshold parameters may include, for 
examples, domain name system (DNS) lookup time, connect time, latency, 
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transfer rate, and throughput. Timing generator 430 is used to generate the 
timing signals required to measure the timing threshold parameters. 

In the addressing scheme of an IP network, an address comprises four 
number strings separated by dots. Each computer system on the network has a 
unique address. For ease of use, names in the form of alphanumeric characters 
(e.g., recognizable words) may be mapped to a number string. The DNS is a 
hierarchical naming scheme and distributed database system for implementing a 
naming scheme for mapping computer system names to IP addresses. The DNS 
lookup time is the time it takes for a client system's browser (in this case the 
remote satellite system) to connect with a DNS database to translate the business 
site web page server's name (e.g., www.nocpulse.com) into an IP address, before 
sending a request to the business site server. As such, connection agent 425 is 
used to establish a connection with a DNS database for a designated URL and 
then, subsequently, establish a connection with the designated URL. 

Once a connection with a particular URL is established, timing analyzer 
440 is used to record detailed timing statistics of a transaction. During the 
transaction, the connect time, latency, transfer rate, and throughput parameters 
may be measured. The connect time is the time it takes for a client system to 
send a request to establish a connection with a business server and receive a 
reply from the business server that a connection is established. 

Additional timing parameters such as latency may also be measured. 
Latency is the time between a client sending in a request for data and getting 
back the first byte of data. For example, for a credit card transaction, a user 
sends in data about his credit card (e.g., account name, credit card number, 
expiration date, etc.) and the items that he wishes to purchase to the business 
site. The business site may then contact the credit card company, where some 
back-end processing is performed, to verify the user's credit. Only after this is 
complete will the business site transmit a confirmation to the user that the 
purchase transaction is complete. In this example, the request for data may be 
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the request for acknowledgement of a completed transaction and the data sent 
back to the user is confirmation that the transaction has been successfully 
completed. As such, the transaction generator 440 performs steps similar to 
those that a user would perform to complete a desired transaction (e.g., a credit 
card transaction). 

The transfer rate is the network rate, or the bytes per second between the 
first byte and last byte of a particular response. Throughput is the time it takes 
(e.g., in bytes per second) for an entire session from DNS lookup to the last byte 
received by a client. 

The remote satellite system may also evaluate correctness parameters of 
the network connection to the business site using verifier 450. Verifier 450 may 
be part of a host program, a separate program on a remote satellite system, or a 
separate program on another system. Verifier 450 may include one or more 
verifiers to evaluate correctness parameters. For example, verifier 450 may 
include a content verifier, a subsidiary page (SUBS) verifier, and link verifier. 

The content verifier verifies the data according to the configuration, for 
examples, the size of the content, the format (HTML vs. XML vs. GIF, etc.), and 
whether the content contains the correct information. Verifying the correctness 
of content may be performed by determining positive or negative search 
patterns on a particular web page. Search patterns may be literal strings such as 
ordered groups of characters (e.g., partial words, words, and phrases with or 
without spacing and punctuation) or regular expressions such as patterns of 
characters (e.g., one or more digits followed by a pound sign). Positive search 
patterns are patterns that must be f ound in the content for the content to be 
considered correct. Negative search patterns are patterns that must not be found 
in the content for the content to be considered correct. 

In one embodiment, the content may be passed off to a SUBS verifier 
which parses the content for subsidiary pages and tries to retrieve each 
subsidiary page. A subsidiary page contains data that is attached to a parent 
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web page. As previously discussed, a web page may contain links to special 
accessory files (e.g., images, frames, background sounds, applets, etc.) that are 
automatically loaded by a client's browser in addition to the text. When a 
client's browser loads a web page that contains an image, for example, at least 
two transactions may be performed: an HTML transaction that loads the text of 
the web page and fetch transaction that retrieves the image file from its storage 
location. As such, evaluating the correctness of such a subsidiary page involves 
determining whether the content of the subsidiary page is available for retrieval. 

In one embodiment, the content may be passed off to a links verifier. A 
web page may also contain links (i.e., strings of text containing IP addresses of 
other web pages) that a user can access by, for example, selecting the link with a 
cursor control device. The links verifier parses the content for links (e.g., HTML 
Anchor tags and hypertexts links) and makes a determination as to whether the 
content on a link is accessible. 

The output of verifier 450 is provided to queuing client 485 to store and 
queue collected data such as performance metrics (e.g., timing parameter 
statistics and correctness parameter checks) and alerts. Queuing client 485 may 
periodically transmit the collected data to results database 470 and/ or a 
notification system such as MOC 230 of Figure 2. The remote satellite 
monitoring system 400 may also include multiple queues for different types of 
data, for example, one queue for correctness parameters and one for timing 
parameters. A priority may be set for each of the queuing clients that 
determines the order in which data will be uploaded. 

The performance metrics may be provided to results database 470 either 
directly via queuing client 460 or by way of another interface where they are 
made available to report generator 460. Report generator 460 generates a report 
file 480 that contains information about the performance metrics. Reports 
generator 460 may generate reports automatically or on demand. A report may 
be, for example, a graph of the connect time over the previous three hours. In an 
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alternative embodiment, the data collected by remote monitoring system 400 
may be transmitted to a MOC, with the MOC performing report generation. 

It should be noted that although the monitoring and evaluating of a 
business site has been discussed at times in relation to an HTML protocol, 
systems operating with other types of protocols, for examples, FTP and Gopher 
may also be monitored and evaluated. 

Figure 5 illustrates one embodiment of a remote satellite system in the 
form of a digital processing system 500 representing an exemplary workstation, 
personal computer, server, etc., in which features of the present invention may 
be implemented. 

Digital processing system 500 includes a bus or other communication 
means 501 for communicating information, and a processing means such as 
processor 502 coupled with bus 501 for processing information. Processor 502 
may represent one or more processors such as a Motorola PowerPC processor or 
an Intel Pentium processor, etc. Digital processing system 500 further includes 
system memory 504 that may include a random access memory (RAM), or other 
dynamic storage device, coupled to bus 501 for storing information and 
instructions to be executed by processor 502. System memory 504 also may be 
used for storing temporary variables or other intermediate information during 
execution of instructions by processor 502. System memory 504 may also 
include a read only memory (ROM) and/ or other static storage device coupled 
to bus 501 for storing static information and instructions for processor 502. 

A data storage device 507 such as a magnetic disk or optical disc and its 
corresponding drive may also be coupled to digital processing system 500 for 
storing information and instructions. The data storage device 507 may be used 
to store instructions for performing the steps discussed herein. Processor 502 
may be configured to execute the instructions for performing the steps discussed 
herein. In one embodiment, digital processing system 500 is configured to 
operate with a LINUX operating system stored on data storage device 507. In 
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alternative embodiments, another operating system may be used, for examples, 
Windows NT and Solaris. 

In one embodiment, digital processing system 500 may also be coupled 
via bus 501 to a display device 521, such as a cathode ray tube (CRT) or Liquid 
Crystal Display (LCD), for displaying information to the user. For example, 
graphical and/or textual depictions/indications of system performance 
characteristics, and other data types and information may be presented to the 
system administrator on the display device 52L Typically, an alphanumeric 
input device 522, including alphanumeric and other keys, may be coupled to bus 
501 for communicating information and /or command selections to processor 
502. Another type of user input device is cursor control 523, such as a mouse, a 
trackball, or cursor direction keys for communicating direction information and 
command selections to processor 502 and for controlling cursor movement on 
display 521. 

A network interface device 525 is also coupled to bus 501. Depending 
upon the particular design environment implementation, the network interface 
device 525 may be an Ethernet card, token ring card, or other types of interfaces 
for providing a communication link to a backbone of an IP network for which 
digital processing system 500 is monitoring. 

It will be appreciated that the digital processing system 500 represents 
only one example of a system, which may have many different configurations 
and architectures, and which may be employed with the present invention. For 
example, some systems often have multiple buses, such as a peripheral bus, a 
dedicated cache bus, etc. 

In one embodiment, communication device 526 may also be coupled to 
bus 501. The communication device 526 may be a modem, or other well-known 
interface device, for providing a communication link to the MOC independent of 
the communication link to which network interface 525 is connected. In this 
manner, communication device 526 provides a backup link to a MOC if the 
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primary link fails as illustrated by Figure 6. For example, remote satellite system 
650 may include a modem to enable communication via the Public Switched 
Telephone Network (PSTN) 625 with MOC 630 independent of the 
communication link through IP network 620. In an alternative embodiment, 
other communication means (e.g., wireless) may be used to enable remote 
satellite system 650 communication with MOC 630 independent of IP network 
620. MOC 630 may include one or more digital processing systems similar to 
digital processing system 500 of Figure 5. 

Figure 7 A illustrates one embodiment of a method of remote monitoring. 
The method may include determining parameters to monitor, step 710. In one 
embodiment, the parameters may be configured by the business site through a 
configuration interface at the MOC and then downloaded by the MOC to one or 
more of the remote satellite systems. Alternatively, the configuration interface 
may reside at a remote satellite system. 

Figure 7B illustrates one embodiment of a configuration interface 760. 
The parameters may include for examples, the URL (the location of the desired 
information, including protocol, server, port, path, and optionally additional 
data) 761, authentication information 762, timing thresholds 763, notification 
configuration 764, features (e.g., check links) 765, pre-set cookie 767. In an 
alternative embodiment, these parameters may be supplied by a business site 
through other means and configured by the MOC, or determined by the MOC as 
discussed above. 

Referring again to Figure 7A, a connection with a particular host (e.g., a 
URL address) is attempted, step 720, so that a transaction may be performed, 
step 725. In one embodiment, one or more timing parameters are measured, 
step 730. In an alternative embodiment, one or more correctness parameters 
may be evaluated, step 740. A determination is made if there are additional 
tansactions, step 755, and additional URLs are to be analyzed, step 750. If so, 
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then steps 720-740 may be repeated. Once one or more URLs are analyzed, the 
collected parameter data is analyzed and the data is uploaded, step 760. 

Figure 8 illustrates one embodiment of a timing parameter measurement 
process. In one embodiment, a high resolution timer is started, step 810. Next, a 
DNS lookup may be performed and the lookup time calculated, step 815. After 
DNS lookup is complete, a connection with a particular URL address of a host 
system is established and the connect time calculated, step 820. Time may be 
calculated with either direct or relative timing measurements. 

The transaction request may be performed and the time of request 
recorded, step 825. Receipt of the first byte of the response is waited for and the 
latency calculated, step 830. When the last byte of data is received, the total time 
is recorded, step 835. The calculation of aggregate timing parameters may be 
performed, step 840, including data transfer rate and throughput. 

Figure 9 illustrates one embodiment of a parameters correctness 
verification process. In one embodiment, the parameter correctness verification 
process may include one or more of the following: verification of search strings 
910; verification of SUBS 930; and verification of links 950. 

Content verification 910 may include selecting a positive search pattern or 
a negative search pattern, step 915; searching the content, step 920; and 
comparing tine pattern with the searched content, step 925. In one embodiment, 
search patterns may be simple strings (i.e., ordered groups of characters), and 
step 925 may include determining if the search string occurs anywhere in the 
content. In another embodiment, search patterns may be regular expressions 
(e.g., three digits followed by a pound sign) and step 925 may include 
determining if any group of characters in the content satisfy the expression. The 
content is successfully verified if the pattern is a positive pattern and the pattern 
matches, or the pattern is a negative pattern and the pattern does not match. If 
there is additional content to be verified, step 926, the process may be repeated. 
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Verification of SUBS 930 may include determining the existence of 
accessory files, step 935. The accessory files are fetched, step 940, and then 
examined to determine if the content of these files is available, step 945. For 
example, a web page may contain a link to an image file that is automatically 
loaded by a client's browser in addition to the text. As such, a fetch transaction 
may be performed to retrieves the image file from its storage location. If no 
image is retrieved then a determination may be made the content of the image 
file is not available for retrieval. The process may be recursive. For example, if 
page A contains subsidiary page B, and subsidiary page B contains its own 
subsidiary page C, then both B and C (and sub-subsidiary pages) are verified. If 
there are additional subsidiary pages to be verified, step 946, the process may be 
repeated. 

Verification of links 950 may include determining the existence of a link, 
step 955, and following the link, step 960. Next, a determination may be made as 
to whether the link is accessible, step 965. In one embodiment, accessibility may 
include downloading the linked data and possibly doing one or more content 
checks (e.g., verify that the returned page is not empty). In another 
embodiment, following the link may include query the linked server to see if the 
linked data is available, but without actually downloading the data. Either 
embodiment, may be implemented by the link verifier directly, or the link 
verifier may drive an external program (e.g., monitoring client 431 of Figure 4). 
The process may be repeated for additional links, step 967. 

In one embodiment, the method and architecture discussed above maybe' 
implemented with an interpreter program. An interpreter is a language 
processor that analyzes a program and then carries out the specified actions 
(processes instructions) at' the time of execution, rather than producing a 
machine-code translation to be executed later (as with a compiler). In one 
embodiment, the steps discussed above are coded using Perl. In an alternative 
embodiment, other programming languages may be used. 

-18- 



I 

WO 02/37280 PCT/USO 1/46 117 

The method and apparatus for remote monitoring of a business site as 
described above may provide valuable information about the business site. By 
positioning the remote satellite systems at points near backbones approximate to 
those of clients accessing a business site, a more accurate analysis of a site's 
performance may be performed that better reflects an end user's true experience. 
In addition, by using dedicated remote satellite systems, consistent information 
about the performance of a business site may be collected independent of 
variations in an end user's client system hardware and software. Moreover, by 
measuring various timing threshold parameters and evaluating correctness 
parameters of the network connection to the customer site, a more detailed 
analysis of a site's performance may be performed. 

In the foregoing specification, the invention has been described with 
reference to specific exemplary embodiments thereof. It will, however, be 
evident that various modifications and changes maybe made thereto without 
departing from the broader spirit and scope of the invention as set forth in the 
appended claims. The specification and drawings are, accordingly, to be 
regarded in an illustrative rather than a restrictive sense. 
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CLAIMS 

What is claimed is: 

1. A system, comprising: 
an intranetwork; 

an extranetwork coupled to the intranetwork; 

a first host digital processing system coupled to the intranetwork, 
the first digital processing system having performance parameters; and 

a first remote digital processing system coupled to the 
extranetwork to monitor a performance parameter, the first remote digital 
processing system coupled to the extranetwork at a first location similar 
to that of a first expected user of the first host digital processing system. 

2. The system of claim 1, wherein the extranetwork comprises a first 
backbone network and wherein the first remote digital processing system 
is coupled to the first backbone network. 

3. The system of claim 2, further comprising a second remote digital 
processing system to monitor a performance parameter of the first host 
digital processing system, wherein the extranetwork further comprises a 
second backbone network and wherein the second remote digital 
processing system is coupled to the second backbone network at a second 
location similar to that of a second expected user of the second host 
digital processing system. 
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4. The system of claim 2, further comprising a monitoring operations 
center coupled to the extranetwork, the monitoring operations center to 
receive data from the first remote digital processing system. 

5. The system of claim 4, wherein the data includes the performance 
parameter. 

6. The system of claim 5, further comprising a second extranetwork 
coupled to the first remote digital processing system and the monitoring 
operations center, the second extranetwork to transmit the data from the 
first remote digital processing system to the monitoring operations center. 

7. The system of claim 6, wherein the second extranetwork is a public 
switched telephone network. 

8. The system of claim 6, wherein the second extranetwork is a 
wireless network. 

9. The system of claim 1, wherein the first remote digital processing 
system is configured to pre-set cookies on the host digital processing 
system. 
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10. The system of claim 9, wherein the host digital processing system 
includes a plurality of web pages and wherein the pre-set cookies enable 
the first remote digital processing system to access a particular one of the 
plurality of web pages independent of another of the plurality of web 
pages. 

11. The system of claim 1, wherein the performance parameter is a 
timing threshold parameter. 

12. The system of claim 11, wherein the timing threshold parameter is 
a domain name system lookup time. 

13. The system of claim 11, wherein the timing threshold parameter is 
a connect time. 

14. The system of claim 11, wherein the timing threshold parameter is 
throughput. 

15. The system of claim 11, wherein the timing threshold parameter is 
a transfer rate. 
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16. The system of claim 11, wherein the timing threshold parameter is 
latency. 

17. The system of claim 1, wherein the performance parameter is a link 
verification. 

18. The system of claim 1, wherein the performance parameter is a 
subsidiary page verification. 

19. The system of claim 4, wherein the first remote digital processing 
system includes a queuing client to control the transfer of data to the 
monitoring operations center. 

20. A method of network monitoring, comprising: 
positioning a remote digital processing system on a backbone 

network remotely from a host digital processing system, the remote 
digital processing system position approximate that of an expected user 
" of the host digital processing system, the host digital system coupled to 
the backbone network through an intranetwork; and 

monitoring a performance parameter of the host digital processing 
f > system with the remote digital processing system. 
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21. The method of claim 20, further comprising transmitting 
information about the performance parameter to a monitoring operations 
center. 

22. A method of claim 20, wherein monitoring comprises: 
determining the performance parameter for monitoring; 
establishing a connection with the host digital processing system; 

and 

performing a transaction with the host digital processing system. 

23. The method of claim 22, wherein determining comprises receiving 
the performance parameter through a configuration interface. 

24. The method of claim 22, wherein establishing comprises pre- 
setting cookies on the host digital processing system to enable the remote 
digital processing system to access data on the host digital processing 
system. 

25. The method of claim 22, wherein the performance parameter is a 
timing parameter associated with the transaction and wherein the method 
further comprises measuring the timing parameter. 



-24- 



WO 02/37280 



PCT/US01/46117 



26. The method of claim 22, wherein the performance parameter is a 
domain name server lookup time associated with establishing the 
connection. 

27. The method of claim 25, wherein measuring comprises calculating 
a latency time. 

28. The method of claim 25, wherein measuring comprises calculating 
a throughput time. 

29. The method of claim 25, wherein measuring comprises calculating 
a connection time. 

30. The method of claim 25, wherein measuring comprises calculating 
a data transfer rate. 

31. The method of claim 22, wherein the performance parameter is a 
correctness parameter and wherein the method further comprises 
evaluating the correctness parameter. 

32. The method of claim 31, wherein evaluating comprises: 
determining a positive search pattern; 
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determining a negative search pattern; and 
comparing the positive search pattern with the negative search 
pattern to verify the correctness of a content. 

33. The method of claim 31, wherein evaluating comprises: 
fetching an accessory file from a storage location; and 
verifying that content of the accessory file is available for retrieval. 

34. The method of claim 31, wherein evaluating comprises: 
selecting a link on a web page; and 

verifying that content corresponding to the web page is accessible. 

35. A method, comprising: 

monitoring performance parameters of a host digital processing 
system coupled to an extranetwork using a plurality of remote digital 
processing systems, the extranetwork comprising a plurality of backbone 
networks, at least one of the plurality of remote digital processing 
systems selectively coupled to at least one of the plurality of backbone 
networks at a position approximate that of an expected user of the host 
digital processing system. 

36. The method of claim 35, wherein monitoring comprises: 
evaluating the performance parameters using one of the plurality 

of remote digital processing systems; and 
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transmitting a report on the evaluating from the one of the 
plurality of remote digital processing systems to another of the plurality 
of remote digital processing systems. 

37. The method of claim 36, wherein evaluating the performance 
parameters includes measuring a timing threshold associated with an 
interaction with the host digital processing system. 

38. An apparatus, comprising: 

means for positioning a remote digital processing system on a 
backbone network remotely from a host digital processing system, the 
remote digital processing system position approximate that of an 
expected user of the host digital processing system, the host digital 
system coupled to the backbone network through an intranetwork; and 

means for monitoring a performance parameter of the host digital 
processing system with the remote digital processing system. 

39. The apparatus of claim 38, wherein the means for monitoring 
comprises: 

means for evaluating the performance parameter; and 
means for reporting the evaluation of the performance parameter 
to a monitoring operations center. 

40. The apparatus of claim 39, wherein the performance parameter is a 
timing threshold. 
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41. The apparatus of claim 39, wherein the performance parameter is a 
correctness parameter. 
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Dispositif de protection des systemes inf ormatiques 
contre les intrusions ou malveillances issues des reseaux de 
communication ouvert sur l'exterieur. 

La prtsente invention concerne un dispositif pour 
5 prottger les systemes inf ormatiques contre les intrusions ou 

malveillances issues d'un reseau de communication ouvert sur 
l'exttrieur tel que celui nomme communement "internet". 

La protection traditionnellement utilis§e est constitute 
d'un logiciel habituellement appele "fire wall". 
10 Ce type de protection n'est pas infaillible car il ne 

rtsout pas le probltme de la presence physique du reseau de 
communication externe sur le ou les serveur(s) de donnees ou de 
messagerie. 

Le dispositif selon l f invention permet de remedier a cet 
15 inconvenient. II comporte en effet un boitier comprenant : 

- un systeme d' exploitation sur technologie carte electronique d 
processeur avec utilitaire de configuration et de connexion au 
reseau exttrieur de communication. 

- la connexion au reseau exterieur de communication est realiste 
20 par I'intermtdiaire d'une interface "ethernet" au travers d ! un 

reseau local avec un serveur specialist ou par 1 1 intermediaire 
d'un communicateur de type modem, RNIS, ADSL ou autre a titre 
d'exemple non limitatif. 

- un systeme de commutation et adaptation rapide permet de 
25 "basculer" une console ou un poste de travail du rtseau local 

et/ou externe de l 1 entreprise, de l'organisme ou de la structure 
sur le reseau exterieur de communication dit "internet" ou autre 
par 1 'intermediaire du systeme d' exploitation dtfini ci-dessus. 

Le principe consiste a ne realiser les connexions au 
30 reseau de communication externe (internet ou autre a titre non 
limitatif) uniquement sur un systeme connexe constitut par le 
systeme d ! exploitation defini ci-dessus. 
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Le reseau de 1 1 entreprise, de I 1 organisme ou de la 
structure est alors compldtement independant physiquement du 
r6seau de communication externe {internet ou autre) ou de toute 
connexion vers un quelconque systeme de communication externe 

5 (internet ou autre. Ainsi, aucun signal et/ou aucune donnEe 

ext£rieurs ne peuvent etre mis en contact avec les bus adresses 
et donn£es des systemes internes (locaux ou distants) de 
1 'entreprise, de 1' organisme ou de la structure. 

L ! unite centrale raccordee au reseau de 1 1 entreprise, de 

10 l' organisme ou de la structure est raccordee au present 
dispositif et le clavier, la souris et l 1 interface d T affichage 
sont g£r£s et commut6s par le syst&ne de commutation decrit ci- 
dessus faisant partie du present dispositif. 

Aucune connexion physique entre le reseau de 

15 communication externe ("internet" ou autre) et l f unite centrale 
du poste de travail n'est possible. La liaison avec le reseau 
externe de communication ("internet" ou autre) est rdalisee par 
le dispositif, soit par modem soit par un autre r6seau local 
independant passant par un serveur specialise independant qui 

20 n'a pas de liaison physique avec le reseau de 1 1 entreprise, de 
1' organisme ou de la structure. 

Dans la forme de realisation, le systeme est compose : 

- d f une carte electronique a et avec processeur (dite "carte 
mere") , 

25 - d f une mEmoire Ram de travail, 

- d'une interface video independante ou integree a la carte 
Electronique sus-citee, 

- d'une interface de communication interne de type ethernet ou 
autre pour connexion §ventuelle a un serveur sp<§cialis6, 

30 - d'une interface de communication externe de type modem et/ou 
RNIS et/ou ADSL et/ou autre pour connexion eventuelle directe, 

- d'une unite de stockage de masse suffisante pour recevoir le 
systeme d' exploitation, le programme interface opdrateur de 
paramStrage, le programme de navigation sur le r6seau de 

35 communication externe ("internet" ou autre), le programme de 
communication et messagerie, le programme de gestion des 
interfaces, les donnees de 1 'utilisateur, 
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- Une prise permettant de raccorder un lecteur de disquette et 
un c§d6rom sur le dispositif pour r6glage et param6trage, 

- un systdme int£gre de commutation de console (p6ripheriques de 
dialogue homme-machine : le moniteur, le clavier et la souris) , 

- un systeme d 1 exploitation, 

- un programme de navigation et de messagerie, 

- un programme interface de~ configuration et de param§trage des 
diff brents parametres necessaires aux modes de communication. 

- une interface parallele pour impression de documents issus du 
reseau externe de communication ("internet" ou autre), 

- les prises pour raccorder l 1 unite centrale du poste de 
travail, le moniteur, le clavier et la souris. 

- A titre d ! exemple non limitatif, la connexion au r6seau 
extdrieur est r£ali~s£e dans la forme de realisation par un 
logiciel de navigation et de messagerie supportes par une carte 
a processeur dont un port est reli6 a une interface reseau, 
RNIS, ADSL ou modem, et peut aussi etre realisee, dans des 
variantes, par tout systeme assurant la meme fonction au sein du 
dispositif. 
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1) Dispositif pour prot£ger les systemes inf ormatiques 
contre les intrusions ou malveillances issues d'un reseau de 
communication ouvert sur l'exterieur tel que celui nomm6 
commun6ment "internet", etant compose : 

- d'une carte 61ectronique k processeur (dite "carte m£re"), 
d'une memoire Ram de travail, 

d'une interface video independante ou integree a la carte 
electronique suscit&e, 

- d'une interface de communication interne de type Ethernet 
pour connexion eventuelle a un serveur specialise, 

d'une interface de communication externe de type modem et/ou 
RNIS et/ou ADSL pour connexion eventuelle directe, 

- d'une unite de stockage de masse suffisante pour recevoir le 
systdme d' exploitation, le programme interface op6rateur de 

15 param^trage, le programme de navigation sur le reseau de 

communication externe tel que "internet", le programme de 
communication et messagerie, le programme de gestion des 
interfaces, les donnees de 1 f utilisateur, 

d'une prise permettant de raccorder un lecteur de disquette 
2Q et un ced§rom sur le dispositif pour reglage et parametrage, 

d'un syst^me integre de commutation de console periph6rique 
de dialogue homme-machine : tel que le moniteur, le clavier 
et la souris, 

d'un syst^me d' exploitation, 
25 - d'un programme de navigation et de messagerie, 

d'un programme interface de configuration et de param6trage 
des differents param^tres n6cessaires aux modes de 
communication . 

d'une interface paralldle pour impression de documents issus 
3 q du r6seau externe de communication, 

des prises pour raccorder 1' unite centrale du poste de 
travail, le moniteur, le clavier et la souris, 
fonctionnant par commutation physique de tout periph6rique de 
dialogue op£rateur avec le poste de travail, sur le systeme de 
35 communication externe du dispositif ind^pendant des r£seaux de 
l'entreprise desservant les serveurs de donnees et 
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d 1 applications ; 1 "utilisateur disposant alors d'une console de 
travail tel que ecran, clavier et souris, pouvant etre 
connectee a son poste de travail qui est sur le reseau de 
1' entreprise ou connectee sur le dispositif qui permet 1'acces 
5 a "internet" et au systeme de messagerie tel que serveur 

entreprise "web" et messagerie ou connexion directe au 
fournisseur d'acces. 

2) Dispositif selon la revendication 1 caracterise en ce 
qu'il comporte un systeme d ? exploitation sur technologie carte 

10 electronique a processeur avec utilitaire de configuration et 
de connexion au reseau exterieur de communication. 

3) Dispositif selon la revendication 1 caracterise en ce 
qu'il comporte un systeme de commutation et adaptation rapide 
permettant de "basculer" une console ou un poste de travail du 

15 reseau local et/ou externe de 1 1 entreprise, de l'organisme ou 
de la structure sur un reseau exterieur de communication tel 
que "internet". 

4) Dispositif selon la revendication 1 caracterise en ce 
que ledit dispositif de commutation ne realise les connexions 

20 au reseau de communication externe qu' uniquement par 
l'intermediaire dudit systeme ; et consequemment, le reseau de 
1 'entreprise, de l'organisme ou de la structure est 
completement independant physiquement du reseau de 
communication externe, et ainsi, aucun signal ou donnee 

25 exterieurs ne peuvent etre mis en contact avec les bus adresses 
et donnees des systemes internes locaux ou distants de 
1' entreprise, de l'organisme ou de la structure. 
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